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DETAILED ACTION 
Response to Amendment 

1 . This action is in response to the amendment dated 02 October 2006 in 
application 09/731,262. Claims 1-15 are pending. Claims 1, 5, 10, 12, 14, and 15 are 
amended. 



Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-4, 10, and 11 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Butler et al. (US20020007493A1) in view of Marshall et al. 
(US005828420A), Kanungo (US20030056215A1), and Fujii (US006959449B1). 

Regarding claim 1 , Butler et al. (Butler) discloses a system that provides 
enhance content with broadcast video. Butler discloses that the receivers or "display 
generator" include a video subsystem for combining ancillary/supplemental data, which 
include a "web page, including a graphics image" (See paragraph 0022 and 0062), and 
broadcast video or "television video image" (See Fig. 2 and 5; paragraph 0009). The 
ancillary data are sent as HTML files or "graphics image being defined by an HTML 
syntax" and the broadcast video is "derived from a real time television signal" (See Fig. 
1; paragraph 0032). The receiver includes a processor that renders the "graphics image 
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to form" an overlay or "rendered graphics image" (See paragraph 0019 and 0051), 
where inherently the processor follows the HTML code for "for parsing, layout and 
rendering". Furthermore, Butler discloses that the overlays are stored in a cache 
storage or "graphics memory" where it can be retrieved for later use (See paragraph 
0055). The receiver further includes a receiver or "television video receiver" for output 
video broadcasted over the network or "having an output forming said television video 
image" (See paragraph 0032). The video subsystem or "video combiner" receives the 
overlays from the cache storage and the broadcast video from the receiver to combine 
the overlays with the broadcast video to produce a "combined display of said graphics 
image and said television video image" (See paragraph 0036), where inherently the 
"individual pixels of said rendered graphics image" are combined with "respective 
individual pixels of said television video image" in order to produce the desired display 
with both the overlays and broadcast video. Furthermore, the broadcast video is 
received through the receiver (See Fig. 2, receiver 58; paragraph 0032) and the 
supplemental data can be received through the modem (See Fig. 2, modem 138; 
paragraphs 0017 and 0041) or "wherein the rendered graphics image and the television 
video image are from different sources". However, Butler does not disclose a controller 
responsive to user inputs to (1) adjust the transparency of the pixels of the rendered 
graphics image and the television image, (2) PIG controls for determining the size and 
position of the real time television signal, wherein the television video image is 
positioned as an overlay of the rendered graphics image, and (3) scrolling the rendered 
graphics image that does not change the position and size of the television video image. 
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(1) Marshall et al. (Marshall) discloses a system for generating an electronic 
program guide (EPG) or "rendered graphics" to be displayed along with program 
broadcast or "television video image". The user of the system can instruct the computer 
or "controller" to select different percentage levels of transparency applied to the EPG 
when displayed with the video or "adjusting a transparency of individual pixels of the 
rendered graphics image and the television video image" (See Fig. 1; column 2 line 35 - 
column 3 line 45). Therefore, it would have been obvious to one with ordinary skill in the 
art at the time the invention was made to modify the video subsystem disclosed by 
Butler to include a controller that is responsive to "user inputs" that adjusts the 
transparency levels of the graphics image and the television video image, as taught by 
Marshall, in order to minimize the obstruction of the video of the broadcast by the 
graphics. 

(2) Kanungo discloses a system where a "web page, including a graphics image" 
is displayed on a television. Kanungo discloses PIG controls for determining the size 
and position of the real time television signal (See Figs. 3a-3d, control 310 and size and 
position 318, Fig. 8A "coordinates of video display"; paragraphs 0050-0054). The 
television video images (See Figs. 3a-3d, video area 304) is positioned as an overlay of 
the web page or "rendered graphics image" (See Figs. 3a-3d, video area 304, web page 
302, and control 310; paragraphs 0050-0054). Therefore, it would have been obvious to 
one with ordinary skill in the art at the time the invention was made to modify the video 
subsystem disclosed by Butler to have PIG controls for determining the size and 
position of the real time television signal, wherein the television video image is 
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positioned as an overlay of the graphics image, as taught by Kanungo, in order to 
provide a more efficient system for displaying data and video to the user thereby 
allowing the system to display other information on the web page (See paragraph 
0052). 

Furthermore, inherently the video combiner is responsive to the transparency 
and PIG controls and the combined display is generated in real time in order to produce 
the desired adjustments on the television screen (See Kanungo Figs. 3a-3d). 

(3) Fujii discloses a system for simultaneously accessing and displaying video 
data and Internet data. Fujii discloses that the user is able to scroll through the web 
page and scrolling through the web page does not change the position and size of the 
television video image (See Fig. 10). Therefore, it would have been obvious to one with 
ordinary skill in the art at the time the invention was made to modify the video 
subsystem disclosed by Butler to allow the user to scroll the rendered graphics image 
that does not change the position and size of the television video image, as taught by 
Fujii, in order to efficiently use the space on the screen thereby providing an improved 
system for simultaneously accessing and viewing video data and Internet data (See 
column 2 lines 3-11). 

Regarding claim 2, as discussed above, the system is able to adjust the 
transparency levels of the graphics image and the television video image. Furthermore, 
the system includes a remote or "transparency control input terminal" that allows the 
user to successfully apply the various levels of transparency (See Marshall Fig. 1; 
column 3 lines 5-45). 
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Regarding claim 3, the system further comprises a "size control input terminal" 
and a "video resizing module" that resizes the broadcast video in response "to a size 
control input to scale said television video image by a factor determined by said size 
control input" (See Figs. 3a-3d, control 310 and size and position 318; paragraphs 
0050-0054). Inherently an input is provided to the receiver and an output is provided to 
the mixer or video subsystem, in order to successfully resize the video within the 
interface (See Kanungo Figs. 3a-3d). 

Regarding claim 4, the system further comprises a position control input, wherein 
the video combiner is responsive to the position control input to form the combined 
image at a position determined by the position control input (See Kanungo Figs. 3a-3d, 
control 310 and size and position 318, Fig. 8A "coordinates of video display"; 
paragraphs 0050-0054). 

Claim 10 contains the limitations of claim 1 (wherein the system performs the 
method) and is analyzed as previously discussed with respect to that claim. 

Claim 1 1 contains the limitations of claims 2 and 10 and is analyzed as 
previously discussed with respect to those claims. 

Claims 5, 7, 8, and 12 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Butler et al. (US20020007493A1) in view of Marshall et al. 
(US005828420A), Kanungo (US20030056215A1), Fujii (US006959449B1), and Kurita 
et al. (US005970511A). 
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Claim 5 contains the limitations of claim 1 and is analyzed as previously 
discussed with respect to that claim. However, Butler in view of Marshall and Fujii does 
not disclose a "television video HTML statement defining a television video HTML 
object" to provide instructions to the video subsystem to "position said television video 
image in said graphics image to form said combined display". 

Kanungo discloses a system where a "web page, including a graphics image" is 
displayed on a television. Within the web page is a video area or "television video HTML 
object" that "positions said television video image in said graphics image to form said 
combined display" (See Fig. 2, Fig. 3A-3D elements 304, Fig. 8A "coordinates of video 
display). Kanungo also discloses that the video area of the web page can be 
implemented as a part of the page described by HTML language (See paragraph 0050). 

Kurita et al. (Kurita) discloses a system that uses HTML language to provide 
information to the users. The system utilizes HTML standards to call or load a moving 
picture file or video, i.e. <video src=http://nearhostY/eee.mpg> or "video HTML 
statement" (See Fig. 7 and Fig. 8 element B) or to load an applet that controls tuner 
functions (See Kanungo Fig. 12), where it is well known that HTML includes various 
commands that involve positioning objects, such as video, within a web page. 

Therefore, it would have been obvious to one with ordinary skill in the art at the 
time the invention was made to modify the receiver and video subsystem disclosed by 
Butler in view of Marshall and Fujii to display the broadcast video as a "television video 
HTML object" within a web page at a desired position or "position said television video 
image in said graphics image to form said combined display", as taught by Kanungo, 
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and to include an "television video HTML statement" to provide instructions to the video 
subsystem, as taught by Kurita, in order to provide seamless integration of video and 
web page data by using an established and well known language thereby increasing the 
amount of entertainment provided to the user. 

Regarding claim 7, Butler in view of Marshall, Kanungo, Fujii, and Kurita 
discloses that the receivers reads and follows the HTML instructions (See Butler 
paragraph 0051). Furthermore, Kanungo discloses a HTML statement that states the 
size of the object (e.g. width = 100 height = 300) (See Kanungo Fig. 12). 

Regarding claim 8, Butler in view of Marshall, Kanungo, Fujii, and Kurita 
discloses that the receivers reads and follows the HTML instructions (See Butler 
paragraph 0051). Furthermore, Kanungo discloses a HTML statement that states the 
position of the object (e.g. align = right) (See Kanungo Fig. 12). 

Claim 12 contains the limitations of claims 5 and 10 and is analyzed as 
previously discussed with respect to those claims. 

Claims 6 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Butler et al. (US20020007493A1) in view of Marshall et al. (US005828420A), Kanungo 
(US20030056215A1), Fujii (US006959449B1), and Kurita et al. (US00597051 1A) as 
applied to claims 5, 7, 8, and 12 above, and further in view of WWW-TV URI/URL/URN 
Usages. 
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Regarding claim 6, Butler in view of Marshall, Kanungo, Fujii, and Kurita does not 
disclose that the receiver is responsive to a HTML statement to determine the channel 
selected by the television receiver. 

WWW-TV URI/URL/URN Usages discloses HTML statements that used within 
web pages to control what channel the tuner is tuned to, e.g. tv://ntsc:4 or <IMG SRC = 
tv:> (See pages 2-3 and 6). Therefore, it would have been obvious to one with ordinary 
skill in the art at the time the invention was made to modify the "television video HTML 
statement" disclosed by Butler in view of Marshall, Kanungo, Fujii and Kurita to include 
commands that "determine the channel selected by said television receiver", as taught 
by WWW-TV URI/URL/URN Usages, in order expand the functionality of the system 
thereby providing more features to the user. 

Claim 13 contains the limitations of claims 6 and 12 and is analyzed as 
previously discussed with respect to those claims. 

Claim 9 is rejected under 35 U.S.C. 103(a) as being unpatentable over Butler et 
al. (US20020007493A1) in view of Marshall et al. (US005828420A), Kanungo 
(US20030056215A1), Fujii (US006959449B1), and Kurita et al. (US00597051 1A) as 
applied to claims 5, 7, 8, and 12 above, and further in view of WWW-TV URI/URL/URN 
Usages and HTML 4.0 Specification. 

Regarding claim 9, Butler in view of Marshall, Kanungo, Fujii, and Kurita 
discloses that the "television video HTML statement" is given by <video 
src=http://nearhostY/eee.mpg> or by loading an applet <applet 
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code=virtualcontrollerapplet ALIGN=right width=100 height=300 vspace=20> (See claim 
5 above). It is well known to add attributes to define objects in an HTML statement as 
shown by Kanungo Fig. 12, e.g. height =300, width=100. However, Butler in view of 
Marshall, Kanungo, Fujii, and Kurita does not disclose that the "television video HTML 
statement" includes the commands: (1) "SRC specifies the source as the Frequency or 
Channel Number" and (2) BORDER specifies the border around said television video 
HTML object". 

(1) WWW-TV URI/URL/URN Usages discloses HTML statements that used 
within web pages to control what channel the tuner is tuned to, e.g. tv://ntsc:4 or <IMG 
SRC = tv:> (See pages 2-3 and 6). Therefore, it would have been obvious to one with 
ordinary skill in the art at the time the invention was made to modify the "television video 
HTML statement" disclosed by Butler in view of Marshall, Kanungo, Fujii, and Kurita to 
include commands that "determine the channel selected by said television receiver", as 
taught by WWW-TV URI/URL/URN Usages, in order expand the functionality of the 
system thereby providing more features to the user. 

(2) HTML 4.0 Specification discloses various commands and attributes used to 
define objects within an HTML statement. The HTML 4.0 specification discloses the use 
of the BORDER function that specifies the border around an object, e.g. an image or 
table (See section 1 1.3). Therefore, it would have been obvious to one with ordinary 
skill in the art at the time the invention was made to modify the "television video HTML 
statement" disclosed by Butler in view of Marshall, Kanungo, Fujii, and Kurita to include 
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commands such as BORDER, as taught by the HTML 4.0 Specification, in order to 
provide more control over how the video object is displayed in respect to graphics. 

Claims 14 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Butler et al. (US20020007493A1) in view of Marshall et al. (US005828420A), 
Kanungo (US20030056215A1), Kurita et al. (US00597051 1A), Fujii (US006959449B1), 
WWW-TV URI/URL/URN Usages, and HTML 4.0 Specification. 

Regarding claim 14, Butler et al. (Butler) discloses a system that provides 
enhance content with broadcast video. Butler discloses that the receivers or "display 
generator" include a video subsystem for combining ancillary/supplemental data, which 
include a "web page, including a graphics image" (See paragraph 0022 and 0062), and 
broadcast video or "television video image" (See Fig. 2 and 5; paragraph 0009). The 
ancillary data are sent as HTML files or "graphics image being defined by an HTML 
syntax" and the broadcast video is "derived from a real time television signal" (See Fig. 
1; paragraph 0032). The receiver includes a processor that renders the "graphics image 
to form" an overlay or "rendered graphics image" (See paragraph 0019 and 0051), 
where inherently the processor follows the HTML code for "for parsing, layout and 
rendering". Furthermore, Butler discloses that the overlays are stored in a cache 
storage or "graphics memory" where it can be retrieved for later use (See paragraph 
0055). The receiver further includes a receiver or "television video receiver" for output 
video broadcasted over the network or "having an output forming said television video 
image" (See paragraph 0032). The video subsystem or "video combiner" receives the 
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overlays from the cache storage and the broadcast video from the receiver to combine 
the overlays with the broadcast video to produce a "combined display of said graphics 
image and said television video image" (See paragraph 0036), where inherently the 
"individual pixels of said rendered graphics image" are combined with "respective 
individual pixels of said television video image" in order to produce the desired display 
with both the overlays and broadcast video. Furthermore, the broadcast video is 
received through the receiver (See Fig. 2, receiver 58; paragraph 0032) and the 
supplemental data can be received through the modem (See Fig. 2, modem 138; 
paragraphs 0017 and 0041) or "wherein the rendered graphics image and the television 
video image are from different sources". However, Butler does not disclose a (1) 
controller responsive to user inputs to adjust the transparency of the pixels of the 
rendered graphics image and the television image, (2) a "television video HTML 
statement defining a television video HTML object" to provide instructions to the video 
subsystem to "position said television video image in said graphics image to form said 
combined display", (3) scrolling the rendered graphics image that does not change the 
position and size of the television video image, and (4) the "television video HTML 
statement" includes the commands: (5) "SRC specifies the source as the Frequency or 
Channel Number" and (6) BORDER specifies the border around said television video 
HTML object". 

(1) Marshall et al. (Marshall) discloses a system for generating an electronic 
program guide (EPG) or "rendered graphics" to be displayed along with program 
broadcast or "television video image". The user of the system can instruct the computer 
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or "controller" to select different percentage levels of transparency applied to the EPG 
when displayed with the video or "adjusting a transparency of individual pixels of the 
rendered graphics image and the television video image" (See Fig. 1; column 2 line 35 - 
column 3 line 45). Therefore, it would have been obvious to one with ordinary skill in the 
art at the time the invention was made to modify the video subsystem disclosed by 
Butler to include a controller that is responsive to "user inputs" that adjusts the 
transparency levels of the graphics image and the television video image, as taught by 
Marshall, in order to minimize the obstruction of the video of the broadcast by the 
graphics. 

(2) Kanungo discloses a system where a web page or also known as a "graphics 
image" is displayed on a television. Within the web page is a video area or "television 
video HTML object" that "positions said television video image in said graphics image to 
form said combined display" (See Fig. 2, Fig. 3A-3D elements 304, Fig. 8A "coordinates 
of video display). Kanungo also discloses that the video area of the web page can be 
implemented as a part of the page described by HTML language (See paragraph 0050). 

Kurita et al. (Kurita) discloses a system that uses HTML language to provide 
information to the users. The system utilizes HTML standards to call or load a moving 
picture file or video, i.e. <video src=http://nearhostY/eee.mpg> or "video HTML 
statement" (See Fig. 7 and Fig. 8 element B) or to load an applet that controls tuner 
functions (See Kanungo Fig. 12), where it is well known that HTML includes various 
commands that involve positioning objects, such as video, within a web page. 
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Therefore, it would have been obvious to one with ordinary skill in the art at the 
time the invention was made to modify the receiver and video subsystem disclosed by 
Butler in view of Marshall to display the broadcast video as a "television video HTML 
object" within a web page at a desired position or "position said television video image 
in said graphics image to form said combined display", as taught by Kanungo, and to 
include an "television video HTML statement" to provide instructions to the video 
subsystem, as taught by Kurita, in order to provide seamless integration of video and 
web page data by using an established and well known language thereby increasing the 
amount of entertainment provided to the user. 

(3) Fujii discloses a system for simultaneously accessing and displaying video 
data and Internet data. Fujii discloses that the user is able to scroll through the web 
page and scrolling through the web page does not change the position and size of the 
television video image (See Fig. 10). Therefore, it would have been obvious to one with 
ordinary skill in the art at the time the invention was made to modify the video 
subsystem disclosed by Butler to allow the user to scroll the rendered graphics image 
that does not change the position and size of the television video image, as taught by 
Fujii, in order to efficiently use the space on the screen thereby providing an improved 
system for simultaneously accessing and viewing video data and Internet data (See 
column 2 lines 3-11). 

(4) Butler in view of Marshall, Kanungo, Kurita, and Fujii discloses that the 
"television video HTML statement" is given by <video src=http://nearhostY/eee.mpg> or 
by loading an applet <applet code=virtualcontrollerapplet ALIGN=right width=100 
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height=300 vspace=20> (See claim 5 above). It is well known to add attributes to define 
objects in an HTML statement as shown by Kanungo Fig. 12, e.g. height =300, 
width=100. 

(5) WWW-TV URI/URL/URN Usages discloses HTML statements that used 
within web pages to control what channel the tuner is tuned to, e.g. tv://ntsc:4 or <IMG 
SRC = tv:> (See pages 2-3 and 6). Therefore, it would have been obvious to one with 
ordinary skill in the art at the time the invention was made to modify the "television video 
HTML statement" disclosed by Butler in view of Marshall, Kanungo, Kurita, and Fujii to 
include commands that "determine the channel selected by said television receiver", as 
taught by WWW-TV URI/URL/URN Usages, in order expand the functionality of the 
system thereby providing more features to the user. 

(6) HTML 4.0 Specification discloses various commands and attributes used to 
define objects within an HTML statement. The HTML 4.0 specification discloses the use 
of the BORDER function that specifies the border around an object, e.g. an image or 
table (See section 1 1.3). Therefore, it would have been obvious to one with ordinary 
skill in the art at the time the invention was made to modify the "television video HTML 
statement" disclosed by Butler in view of Marshall, Kanungo, Kurita, and Fujii to include 
commands such as BORDER, as taught by the HTML 4.0 Specification, in order to 
provide more control over how the video object is displayed in respect to graphics. 

Claim 15 contains the limitations of claim 14 and is analyzed as previously 
discussed with respect to that claim. 
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Response to Arguments 

3. Applicant's arguments with respect to claims 1-15 have been considered but are 
moot in view of the new g round (s) of rejection. 

Furthermore, Applicant argues with respect to claims 1-15 that Butler does not 
disclose combining individual pixels. However, reading the independent claims in the 
broadest sense, Butler does meet the limitations of the claim. Butler does disclose that 
the pixels are overwritten; nevertheless, all the pixels or "individual pixels" of the 
rendered HTML image are overlaid or will overlay or "combined or to join" with the 
respective pixels of the video stream in order to produce one display with both the video 
stream and HTML image (See Fig. 3; paragraph 0036 and 0044). Certain pixels of the 
HTML image are overlaid with pixels from the video stream and certain pixels of the 
HTML image will overlay respective pixels of the video stream thereby combining the 
video stream and HTML image into one display. This is inherent to the process of 
chroma keying/color keying disclosed by Butler. Therefore, Butler does disclose a 
process that "combines individual pixels of the rendered graphics image with respective 
individual pixels of the television video image" in order to produce a combined display. 

Applicant is reminded that although the claims are interpreted in light of the 
specification, limitations from the specification are not read into the claims. See In re 
Van Geuns, 988 F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). 
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Conclusion 

4. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Joseph G. Ustaris whose telephone number is 571-272- 
7383. The examiner can normally be reached on M-F 7:30-5PM; Alternate Fridays off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Christopher S. Kelley can be reached on 571-272-7331 . The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 





November 6, 2006 




